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"It  la  asaantlal  that  the  aonar  designer  be  In¬ 
formed  es  to  the  char ac ter 1  at  lea  of  obaervera 
as  sell  aa  to  the  characteristics  of  the  trans¬ 
acting  medium.  Sonar,  then,  is  bounded  on  one 
aide  by  oceanography  and  on  the  other  by  paycho- 
phyalology  .... 

"The  primary  purpose  of  every  indicator  or  re¬ 
corder  used  in  sonar  is,  in  some  say  or  other, 
to  make  the  signal  perceptible  to  the  observer 
.  .  .  the  quantitative  evaluation  of  the  per¬ 
formance  of  the  instrument  Involves  defining  the 
limiting  conditions  under  which  the  effect  to  be 
produced  is  adequately  perceptible.  This  implies 
that  the  operation  of  any  instrument  is  a  Joint 
enterprise  in  shlch  the  instrument  is  one  partner 
and  the  observer  the  other.  In  stating  the  per¬ 
formance  of  the  instrument  quantitatively,  there¬ 
fore,  certain  physiological  end  psychological 
characteristics  of  human  beings  are  quite  es 
relevant  as  the  nature  and  behavior  of  acoustic 
saves  In  the  sea,  or  as  the  properties  of  the 
system  by  which  these  waves  are  caused  to 
Influence  the  Instrument." 


From:  The  Fundamentals  of  Sonar, 
by  Dr.  J.  W.  Horton 
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FOREWORD 

In  1938  a  contract  was  established  between  ONR  and  HFR  for  the 
broad  purpose  of  determining,  in  objective  quantitative  terms,  the 
capabilities  and  limitations  of  Navy  personnel  In  relation  to  the 
performance  of  various  ASW  systems.  Target  classification  was  the 
most  pressing  problem  at  the  time,  and  much  of  the  early  work  was 
concentrated  in  that  area.  More  recent  work  has  been  directed  to¬ 
ward  measurement  of  the  human  role  in  target  detection  and  equip¬ 
ment  calibration  and  maintenance. 

For  the  most  part,  the  investigations  have  been  experimental 
rather  than  analytical  in  nature.  The  scene  of  the  experiments  has 
varied  with  the  problem:  the  laboratory,  the  ASW  Schools,  aboard 
ships  and  aircraft  underway.  Attention  has  been  focused  on  the 
routine  performance  problems  faced  by  operating  and  training  per¬ 
sonnel  In  attempting  to  maximize  the  performance  of  syst  /as  to 
which  the  Navy  is  fully  committed.  Little  emphasis  has  been 
placed  on  future  systems  although  much  of  value  has  been  learned 
that  should  be  applied  to  future  systems. 

The  emphasis  on  existing  systems  has  resulted  in  a  far  dif¬ 
ferent  orientation  and  a  more  basic  appreciation  of  the  Navy's 
operating  problems  than  otherwise  would  have  been  thfc  case. 

Project  personnel  have  operated  some  equipment,  calibrated  sonar 
equipment,  repaired  sonar  equipment,  designed  data  collectijn 
.ercises,  directed  exercises  from  CIC,  studied  the  ASW  problem 
through  the  eyes  of  seamen,  petty  officers,  and  captains,  ridden 
destroyers,  submarines,  airplanes,  and  helicopters,  and  have 
heard  all  of  the  standard  rationales  for  why  things  don't  work 
better. 
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The  results  of  this  work  have  been,  In  sone  cases,  obvious  and 
concrete;  in  others  they  have  been  subtle,  constituting  more  of  an 
influence  than  an  objective  achievement.  Twenty-seven  technical 
reports  have  been  Issued ,  films,  slides,  magnetic  tapes  and  techni¬ 
cal  manuals  have  been  orepared  and  distributed,  the  staff  has 
served  in  working  groups  concerned  with  the  analysis  of  ASW  systems, 
the  design  of  sonar  trainers,  and  the  conduct  of  evaluatlonal  testa. 

This  summary  report  has  been  prepared  as  a  means  of  reminding 
those  who  design,  purchase,  or  use  ASW  equipment  that  the  Navy  has 
supported  a  good  deal  of  research  that  lcglcally  should  influence 
decisions  concerned  with  the  "Joint  enterprise  In  which  the  instru¬ 
ment  is  one  partner  and  the  observer  the  other."  In  addition,  it 
hopefully  will  be  a  more  conveniant  reference  than  the  27  technical 
reports,  some  classified,  some  not,  that  by  now  may  be  scatterec  in 
diverse  files,  drawers,  and  libraries. 

With  apologies,  wa  must  confess  that  the  results  of  psycho¬ 
logical  experiments  are  not  always  reported  in  a  form  that  immedi¬ 
ately  suggests  the  ray  to  apply  them  In  the  practical  environment. 

Of  course,  this  Is  true  of  nearly  all  "basic”  research.  However, 
many  of  the  findings  summarized  here  have  been  applied  and  many 
others  could  be  with  very  minor  efforts  at  translation. 
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SIX  YEARS  OF  RESEARCH  ON  HUMAN  FACTOR 
PROBLEMS  IN  ASW:  A  SUMMARY 


INTRODUCTION 

The  investigation!  conducted  under  this  contract  can  be  grouped 
into  nine  basic  areas.  Fee  studies  belong  exclusively  to  a  single 
ares,  and  it  sill  be  seen  that  findings  from  a  single  study  are 
sonetlmea  appropriately  classified  under  lore  than  one  of  the  fol¬ 
iosing  headings: 


Development  of  fundamental  concepts  of  target 
classl fleet  Ion 

Analyses  of  clues  displayed  by  operational 
equipment 

Determination  of  operator  capabilities  in 
target  classification 


rch  on  experimental  display  techniques 


Determination  of  the  operator's  role  In 
target  detection 

Studies  of  operator  vigilance 

Recording  of  target  data  at  sea 

Determination  of  calibration  and  maintenance 
skills  of  sonar  technicians 

Analyses  of  ASW  systems  in  operation 


In  the  aectlons  that  folios,  the  specific,  findings  In  each  of 
the  above  areaa  are  concisely  summarized.  The  technical  report  from 
which  each  finding  or  conclusion  sas  taken  la  Indicated  at  the  end 
of  each  statement  by  the  number  In  parentheses.  The  full  title  of 
each  referenced  report  la  listed  at  the  end  of  this  summary. 
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I  DEVELOPMENT  Of'  FUNDAMENTAL  CONCEPTS 
OF  TARGET  CLASSIFICATION 


In  December  1958  ,  HFR  conducted  a  workshop  in  target  classifi¬ 
cation  at  the  U  S.  Navy  Tactical  AShi  School,  Norfolk,  Virginia. 
Discussions  centered  around  float  experience  in  relation  to  the 

findings  of  several  years  of  previous  research  or.  target  clatslfl- 

! 

cation  that  had  been  conducted  by  NEL  and  HFR  It  became  evident 
during  the  workshop,  which  was  attended  by  representatives  of  almost 
every  ASW  operational  and  training  command,  that  there  were  many 
diverse  opinions  concerning  the  value  and  role  in  target  classifi¬ 
cation  of  various  displays  and  the  clues  they  presumably  provided. 
Consequently,  HFh  assumed  the  oblicatlon  of  developing  a  logical 
framework  for  target  classification  that  would  encompass  all  dis¬ 
plays,  clues,  and  procedures  known  to  be  of  value  in  classifying 
with  active,  scanning  sonars. 


Sped  f  lc  Results 

1.  The  logical  basis  for  target  classification  with 
scanning  sonars  wss  established.  It  was  shown  how 
classification  depends  on  determining  tne  target’s 
motion,  size,  rsflsctlvs  structure,  aspect,  and 
depth.  The  role  of  each  display  in  contributing 
partial,  complsmsntary  information  about  one  or 
more  of  these  target  attributes  was  dsscrlbsd  (0)  * 

2.  It  was  shown  why  target  classification  should  bo 
based  on  a  tost  of  ths  "submarlns  hypothasls"  and 
why  prsvlous  emphasis  on  identifying  various  classes 
cf  nonsubmarina  targets  ess  neither  necessary  not 
desirable  (0). 

3.  The  value  of  using  displayed  target  aspect  (orien¬ 
tation  in  ths  sound  beam)  as  ths  basis  for  corre¬ 
lating  and  evaluating  all  other  displayed  clues  was 
established  (0). 


•This  first  report  issued  under  Contract  Nonr  2049(00)  did  not 
bear  a  series  number  as  did  subaequ-nt  ones.  For  convsniancs  it 
is  referred  to  hers  a,  report  No.  0. 
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4.  It  was  shown  how  each  clue  and  various  combinations 
of  clues  relate  to  estimations  of  the  major  charac¬ 
teristics  of  the  target  (motion,  size,  reflective 
structure,  aBpect  depth)  and  how  these  character¬ 
istics,  In  turn,  are  combined  to  establish  the 
probable  nature  of  the  target  (0). 

5.  It  was  shown  how  classification  Is  made  more  or  less 
difficult  depending  on  the  target's  speed,  depth, 
range  from  the  A/8  vessel,  apparent  aspect,  aspect 
changes,  and  geographic  location  (11), 

6-  It  was  shown  that  evaluation  of  classification 
evidence  is  hindered,  In  part,  by  the  fact  that 
U.  S.  systems  provide  no  direct  information  about 
target  depth  (10). 


Importance  to  the  Wavy 

The  first  technical  report  issued  under  this  contract,  Tarttt 
CittaalflcaUan  ilalnz  Ac.llv.ft  §c».imlnft  ga.na.rt ,  has  been  adopted,  un¬ 
changed,  as  an  official  NAVPERS  publication  on  the  subject  of 
classification.  It  serves  as  the  standard  text  for  target  classi¬ 
fication  training  courses  in  the  AST  Schools  and  has  directly 
Influenced  the  design  considerations  of  engineers  concerned  with 
the  construction  of  specialized  equipment  for  target  classification. 
Thla  publication  la  also  serving  as  a  model  for  a  similar  one 
being  developed  for  the  British  Navy  by  personnel  attached  to 
H.M.S.  VERNON. 
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ANALYSES  OF  CLUES  DISPLAYED 
BY  OPERATIONAL  EQUIPMENT 


The  oroclse  character  and  significance  of  target  clues  in  dis¬ 
played  sonar  echoes  cannot  be  determined  in  advance  of  actual  trials 
at  sea  with  targets  that  are  representative  of  the  classification 
problem  HFR  has  collected  and  analyzed  thousands  of  feet  of  motion 
picture  records  and  tape  recordings  of  displayed  signals  from  a 
wide  variety  of  sonar  contacts 


Sped  f  1  c  Rasul  t3 

7.  Detailed  descriptions  of  usable  clues  from  the 
audio,  PPI,  and  graphic  recorder  displays  ol  the 
SQS-a  and  SQS-29  were  developed.  The  probability 
of  occurrence  and  perceptibility  of  each  clue  by 
operators  and  the  manner  In  which  clues  vary  or 
change  as  a  result  of  equipment  control  settings, 
sonar  conditions  and  target  maneuvers  was  de¬ 
scribed  (0)  . 

8.  The  number,  description,  and  usefulness  (validity) 
for  claaslf lcatlon  of  target  pip  shapes  displayed 
by  the  SQS-23  PPI  wee  determined.  It  was  shown 
that  the  pip  shape  categories  developed  for  earlier 
scanning  sonars  were  not  adequate  for  the  SQS-23 
(22)  . 

0.  It  was  shown  that  pip  shapes  are  not  highly  related 
to  target  nature  in  a  direct  sense,  but,  In  the  case 
of  submarine  targets,  often  provide  evidence  of 
target  orientation  that  is  highly  useful  for  evalu¬ 
ating  the  total  clue  pattern  (22). 

10.  It  was  shown  that  the  usefulness  fc,  classification 
of  SQS-23  pip  shapes  was  heavily  dependent  upon  the 
range  scale  In  use,  that  meaningful  shapes  occur 

vary  Infrequently  whan  using  the  5000-yard  (or  greater) 
range  scale.  The  relationship  between  the  type  of 
pip  shape  obtainable  from  a  submarine  target  and  the 
PPI  centering  mode  in  use  (SCD  or  TCD)  was  determined 
(22)  . 

11.  The  extreme  difficulty  of  analyzing  the  motion  of 
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either  slow-moving  or  non-moving  targets  with 
present  displays  and  plotting  equipment  was 
reported,  and  the  superior  capability  of  some 
European  sonar  systems  in  this  respect  was 
described  (23,  27). 


Importance  to  the  Navy 

Continuing  analyses  of  clue  patterns  are  essential  to  progress 
in  target  classification  since  any  change  in  either  the  transmission, 
reception,  or  processing  features  of  a  sonar  is  likely  to  Introduce 
corresponding  (and  unknown)  changes  In  the  meaningfulness  of  the 
clue  patterns.  Significant  details  and  relationships  are  not 
affectively  determined  from  regular  fleet  operations  or  ASW  ^er- 
clses.  Furthermore,  even  the  advent  of  e>u  . tssful  au*n  int1;  classi¬ 
fication  systems  will  not  eliminate  the  n*-  or  :  *  basic 

analyses  to  determine  the  meaningful  informal!;..  an.  era 

The  results  of  these  analyses  to  date  have  It  ii  a*»d  ♦hree 
Important  needs  for  improved  display  design: 

(1)  There  continues  to  be  an  urgent  need  for  a 
simple,  reliable  electronic  aid  to  doppier 
discrimination. 

(2)  The  display  of  target  axis  iniormation  nt 
ranges  considerably  greater  than  those 
obtainable  with  present  PPIs  Is  essential. 

(3)  Improved  means  for  establishing  target 
motion  and  target  track  ii  the  sonar  team 
Is  urgently  required. 

The  lack  of  suitable  displays  for  asseu!.tng  the  motion  of  slow- 
moving  (or  non-moving)  targets  In  the  shortest  possible  time  la 
seriously  hampering  classification.  Ths  discrimination  of  doppler 
by  operators  Is  unreliable;  the  DRT  plots  snd  ths  computed  fire- 
control  solution  are  both  too  slow  ard  too  Inaccurate  for  classi¬ 
fication  purposes.  (It  must  be  remembered  that  a  fast,  or  even 


5 

CONFIDENTIAL 


v..' -  .Hat 


r.  U^Jj.'SWySA.  '*ttiib'b 

%h".‘. 


?v'S%5  -*sb&&&&&;dix‘j!A- 


BBi&&&gaiM 


if 

— *— — 1 - -  -  "  •  1  •’  l~1"1  -‘*J- . . r  11111111,'  i- . --■■  . . 


CONFIDENTIAL 


I 

i 

I 

I 

I 

I 

I 

\ 

I 

I 

l 

[ 

1 

r 

[ 

i 

i 


moderately  fast-moving  submarine  is  not  a  classification  problem, 
although  it  may  well  be  a  tracking  and  a  fire-control  problem.! 

A  sensitive  semi-automatic  target  plot  fed  by  data  generated 
by  equipments  already  in  typical  shipboard  sonar  systems  would  be 
a  major  step  toward  improving  classification. 
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III.  DETERMINATION  OF  OPERATOR  CAPABILITIES 
IN  TARGET  CLASSIFICATION 

It  is  extremely  difficult  to  make  fair,  objective  assessments 
of  the  more  subtle  capabilities  of  sonar  personnel  on  the  basis  of 
their  performance  in  the  actual  operating  environment.  Unlike  radar 
operations  which  routinely  provide  the  opportunity  for  radarmen  to 
practice  and  develop  operating  techniques,  sonar  operations  simply 
do  not  regularly  enable  sonarmen  to  exercise  and  reinforce  the 
complex  skills  Involved  in  detecting,  classifying,  and  tracking 
underwater  targets.  The  result  is  that  specific  performance  de¬ 
ficiencies  often  go  undetected  for  months,  If  not  years.  Further¬ 
more,  ASW  exercises  do  not  readily  permit  the  diagnosis  of  the 
strengths  and  weaknesses  of  Individual  team  members,  since  they  are 
primarily  designed  and  evaluated  on  the  basis  of  the  tactical  and 
veapons-del 1  very  phases  of  the  problem. 

The  measurement  of  specific  operator  capabilities  and  weaknesses 
serves  at  least  three  very  Important  needs:  (1)  It  enables  Intel¬ 
ligent  training  emphasis  to  be  placed  on  those  aspecta  of  the  Job 
that  are  most  difficult;  (2)  It  enables  meaningful  performance 
standards  to  be  established  for  evaluating  new  dlsolays  requiring 
human  monitors;  and  (3)  It  provides  criteria  for  assessing  the 
capabilities  of  machines  that  are  proposed  as  substitutes  for 
functions  traditionally  performed  by  men. 


12.  Both  practical  and  written  tests  of  target  classi¬ 
fication  skills  and  knowledge  have  been  constructed. 
"Trained"  sonar  operators  have  been  found  typically 
to  score  between  50%  and  70%  correct  on  practical 
tests  comprised  of  fairly  difficult  classification 
problems-  They  score  somewhat  higher  on  written 
tests  (10).* 

*Ch«nc»  performance  on  a  balanced  test  permitting  only  two  cor,- 
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13.  Hirked  Individual  differences  have  been  found 
ai.iune  sonarmen  In  ability  to  assimilate  target 
classification  training  (101. 

14.  Target  cl as s 1 f 1 c a t 1 cn  training  has  been  shown  to 
be  more  effective  among  operators  who  ha  -e  had 

sea  experience  than  among  trainees  just  out  of  basic 
training  (10). 

15.  Sonar  trainees  make  frequent  perceptual  errors  In 
clue  recognition  even  at  the  completion  of  training. 
Performance  is  somewhat  better  on  clues  displayed 

by  the  graphic  recorder  than  on  the  audio  or  PPI-- 
presumably  because  of  the  "memory"  characteristic 
of  that  display  (10). 

16.  Present  sonar  displays  are  not  well  suited  to 
accurate  clue  recognition.  Thirty  (or  more)  suc¬ 
cessive  echoes  are  frequently  required  for  correct 
classification  concepts  to  form.  A  ma.lor  source  of 
errors  results  from  inability  to  form  correct  con¬ 
clusions  about  the  target’s  aspect  and  movement  (10). 

17.  The  average  sonar  operator  requires  about  22  cps  of 
dopp’.er  for  accurate  doppler  recognition  using 
SQS-4  and  SQS-29  series  sonars.  Depending  on  the 
nodcl,  reliable  dl serf  ml nn ti on  thus  requires  a  subma¬ 
rine  speed  component  of  from  2.2  to  3.9  knots  in 

the  direction  of  the  sound  beam  (12). 

18.  The  average  sonar  operator  can  reliably  discrimi¬ 
nate  about  12  cps  of  doppler  wltn  SQS-23  sonars. 

This  Is  equivalent  to  about  3.9  knots  of  target 
speed  In  the  direction  of  the  sound  bean  (23). 

19.  Operators  experience  difficulty  In  recognising  "no" 
doppler  as  well  as  small  amounts  of  "up"  and  "down 
doppler.  However,  a  Judgment  bias  noted  with  older 
sonars  toward  reporting  "up”  doppler  when  no  doppler 
was  present  was  found  to  be  less  prounounced  with 
RDT-nodlfled  sonars  (12,  23>. 

20.  There  are  large  Individual  differences  among  sonar 
operators  In  doppler  recognition  ability.  Task 
assignments  within  the  team  snould  reflect  these 
differences  (23). 

clualons  (i.e.,  "submarine”  and  "nonaubaarlne" )  Is  90%.  Thus  the 
performance  level  reflected  by  these  figures  Is  0%  to  20%  above 
what  would  result  from  sheer  guesswork. 
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22.  A  moderate  correlation  typically  la  found  between 
Sonar  Pitch  Memory  Test  scores  and  performance 
on  tests  of  doppler  discrimination  Higher  cut¬ 
off  scores  on  this  test  or  use  of  an  actual  dopf ler 
discrimination  test  would  result  in  improved 
selection  of  operators  for  this  task.  Improved 
selection  is  a  surer  road  to  improved  performance 
than  is  increased  training  (12). 


Importance  to  the  Haw 

Improvement  in  target  classification  performance  can  be  expected, 
provided  that:  (1)  fundamental  improvements  in  the  display  of  cer¬ 
tain  clues  are  achieved;  (2)  training  in  classification  techniques 
is  concentrated  on  those  tho  are  highly  screened  from  an  aptitude 
and  motivational  point  of  vie*.  Display  improvements  are  essential; 
capitalization  on  individual  differences  in  aptitude  and  interest 
is  only  sensible. 


Before  investing  in  expensive  new  displays  or  automatic  process¬ 
ing  devices  that  are  proposed  as  replacements  for  functions  tradi¬ 
tionally  performed  by  men,  the  performance  of  such  devices  should 
be  compared  with  that  of  properly  trained  operators  using  appro¬ 
priate  problem  material.  tn  spite  of  their  limitations,  men  have 
actually  performed  much  better  on  some  tasks  involved  in  classi¬ 
fication  than  have  some  fairly  expensive  electronic  eubstltutes. 


I 
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IV.  RESEARCH  ON  EXPERIMENTAL  DISPLAY  TECHNIQUES 

Thorough  consideration  of  tha  man-machine  Interface  la  esaen- 
tlal  to  the  proper  design  of  any  complex  system.  In  sonar,  more 
effort  seems  to  have  been  spent  trying  to  design  the  nan  out  of 
the  system  than  in  optimally  designing  It  for  his  use. 

It  seems  unlikely  that  signal  analysis  and  Interpretation  will 
become  fully  automatic  Is  the  foreseeable  future.  In  the  meantime, 
there  appear  to  be  many  opportunities  to  design  displays  that  take 
better  advantage  of  the  unique  capabilities  of  men. 


Specific  Results 


23.  The  optimal  audio  frequency  for  doppler  recognition 
is  about  900  cpa  In  contrast  to  the  800  or  1000  cps 
typically  used  In  sonar  systems  (23). 

24.  A  proposed  technique  for  speed-translating  sonar 
signals  to  enhance  doppler  effects  was  shown  to 
produce  no  systematic  improvement  in  doppler 
discrimination  (12). 

29.  An  experimental  device  designed  to  display  doppler 
visually  was  found  to  be  less  effective  than  aural 
discrimination  by  the  average  sonar  operator  (12). 

20.  There  la  a  critical  need  for  achieving  an  inter¬ 
pretive  natch  between  the  meaning  of  a  classifi¬ 
cation  display  to  the  tactical  officer  and  the 
discriminating  capabilities  of  the  sensing  and 
data-proceaslng  equipment.  There  is  a  lack  of 
understanding  among  many  ASV  decision-makers  of 
the  probabilistic  nature  of  sonar  target  classifi¬ 
cation  that  naturally  results  from  Imperfect 
sensors  and  Information  displays  (21). 

27.  Use  of  the  traditional  3-way  classification  scheme 
("probable  submarine,"  "possible  submarine," 
"nonsubmarine" )  results  In  aerlous  losses  of  In¬ 
formation  for  the  tactical  decision-maker.  Dis¬ 
plays  of  the  typa  used  with  N1TBC  are  much  better 
but  require  training  in  Interpretation  (21). 
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. 

Importance  to  the  Navy 

The  perceptions,  Judgments,  and  decisions  of  humans  mill  con¬ 
tinue  to  be  critically  Important  In  any  existing  or  provable  future 
sonar  system.  The  nature  of  the  demands  may  change,  or  they  may  be 
Imposed  at  a  different  point  in  the  processing  and  evaluating 
sequence,  but  they  sill  remain  critically  Important  to  successful 
functioning  of  the  overall  system.  Not  only  *111  It  continue  to  be 
necessary  to  deal  with  human  decision  functions,  but  It  *111  remain 
desirable  to  capitalize  on  the  flexibility  that  only  man  can  bring 
to  the  problem. 


Research  thus  far  suggests  that  far  greater  skill  is  necessary 
In  coupling  machine  and  man  functions  In  sonar  system*  than  has 
been  demonstrated  In  the  past.  Output  displays  generally  need  to 
be  made  more  meaningful;  training  in  interpretation  must  be  made 
more  uniform  and  sophisticated. 
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V.  DETERMINATION  OF  THE  OPERATOR'S  ROLE 
IN  TARGET  DETECTION 

No  other  requirement  has  so  dominated  sonar  equipment  design 
requirements  over  the  past  SO  years  than  tint  of  extending  the 
target  detection  range.  The  resulting  increase  in  equipment  com¬ 
plexity  and  predictable  accompanying  maintenance  problems  have 
created  serious  doubt  that  the  detection  performance  of  the  newer 
systems  is,  in  fact,  uniformly  better  than  that  of  older,  simpler 
ones . 

A  great  deal  of  improvement  in  sonar  detection  could  be  forth¬ 
coming,  howeve<*.  through  Increasing  attention  to  the  complementary 
capabilities  of  man  and  machine.  Human  operators  are  exceptionally 
adept  at  the  detection  of  complex  aural  and  visual  signals  in  heavy 
background  noise.  However,  they  are  often  very  poor  at  sustaining 
attention  tor  such  signals  over  prolonged  periods  of  time,  espe¬ 
cially  if  the  signals  occur  very  Infrequently.  Machines  can  be 
built  that  are  perfectly  attentive  and  have  infallible  memories 
but  to  date  their  pattern  recognition  performance  haw  not  matched 
the  flexible  and  adaptive  capabilities  of  man  for  recognizing  a 
variety  of  signal  types  in  backgrounds  of  non-random  noise. 

There  is  little  doubt  that  improvement  in  target  detection 
performance  is  achievable.  There  is  also  little  doubt  that  it  will 
require  more  effective  man-machine  coupling  than  has  been  tj pical 
of  past  systems.  Severs!  HFR  studies  have  been  directed  toward 
these  problems. 


29.  There  are  large  individual  differences  among 

operators  in  detecting  targets  on  PP1  displays. 
Performance  on  watch  is  moderately  predictable 
from  short  samples  of  performance  during  "alerted" 
conditions  (16). 
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The  requirement  to  search  the  entire  PPI  scope 
results  In  aboui  13%  fewer  detections  on  the 
average  than  when  the  operator  Is  "alerted"  to 
the  target : s  probable  bearing.  (A  performance 
loss  of  3.3  db  with  respect  to  a  reference  signal 
th&t  Is  just  barely  detectable.)  (16) 

Operators  more  quickly  detect  targets  at  mid-range 
on  the  PPI  scope  than  at  close  or  far  range.  The 
explanation  may  lie  in  the  visual  searc  .>  patterns 
adopted  by  operators  (20). 

There  are  large,  stable  individual  differences 
among  operators  In  ability  to  detect  weak  Infrequent 
signals  <2). 

Repeated  presentations  of  a  target  signal  (up  to 
S  echoes)  are  often  necessary  to  elicit  valid  de¬ 
tection  reports  (S). 

Operators  have  different  personal  criteria  of  ehat 
constitutes  a  sonar  target  signal.  The  relative 
leniency  or  stringency  of  each  operator's  criterion 
substantially  affects  the  likelihood  of  a  detection 
being  reported  and  the  false  alarm  rats  (5). 

rnint.  echo  detsctlon  Is  a  function  of  training  and 
sxperlsnca  in  addition  to  basic  opsrator  sensi¬ 
tivity  (3). 

Target  detection  performance  is  unrelated  to 
tredltlonai  achievement  scores  in  sonar  opsrator 
courses  or  to  scores  on  presently  used  aptitude 
tests  (16). 

In  accord  with  observations  by  Horton  (Fundamentals 
of  Sonar) .  the  range  between  10%  and  00%  probability 
of  detsctlon  on  a  PPI  scope  is  only  about  4.S  db; 
the  range  beteeen  "almost  never"  and  "almost  always" 
detecting  a  ta  rgst  is  about  10  db.  Thus  display 
design  features  (or  opsrst: nc  nrocedures)  that  improve 
systems  performance  as  little  as  1  db  are  well  worth 
the  trouble  (16). 

Setting  the  PPI  scope  brightness  at  "visual  reference 
Intensity,"  as  often  recommended  in  technical  manuals, 
adversely  affects  target  detsctlon.  The  optimum 
brightness  Is  veil  above  this  setting  (17). 
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39.  Sonar  operators  typically  do  not  adjust  CRT  bias 
and  gain  optimally  lor  detection  performance. 

Targets  producing  low  intensity  signals  can  be 
detected  with  much  greater  frequency  using  experi¬ 
mentally  determined  optimum  settings  than  when 
using  settings  "preferred"  by  operators  (20). 

40.  A  3-db  gain  In  detection  performance  of  an  operating 
SQS-23  was  obtained  when  ship's  operators  used 
experimentally  determined  optimum  bias  and  gain 
settings  In  contrast  to  their  normally  preferred 
settings  (26)  . 

41.  Search  radars  in  patrol  aircraft  (P2Vs  and  P5Hs) 
are  also  likely  to  be  operated  at  non-optimum 
brightness  levels.  ambient  illumination  in  the 
P5M  aircraft  la  sufficiently  variable  to  Introduce 
serious  losses  in  detection  probability. 

There  are  also  adverse  effects  on  target  detection 
of  the  relatively  high  compartment  Illumination  In 
the  HSS-2  and  of  the  consequent  requirement  that  a 
viewing  hood  bo  used  (17,  IS). 


Importance  to  the  Navy 

The  use  of  cathode  ray  tubes  se  detection  displays  requires 
continuing  research  Into  the  questions  of  optimal  design  and 
operator  procedures.  It  Is  clear  that  the  actual  detection 
capability  of  a  complex  sensor  system  may  be  far  different  from 
Its  theoretical  capability,  as  a  result  either  of  Inappropriate 
control  settings  or  non-optimum  visual  search  procedures,  or  both. 

Target  detection  performance  also  can  be  Improved  by  proper 
selection  of  personnel  and  more  comprehensive  training.  8a  lection 
should  be  directed  toward  obtaining  personnel  who  are  highly 
vigilant  for  the  type  of  displays  used  for  sonar  (see  Topic  VI). 
Training  should  be  directed  toward  procedures  for  calibrating  the 
displays  properly,  optimum  visual  search  patterns,  and  echo  recog¬ 
nition.  Existing  training  equipment  Is  not  properly  designed  for 
training  these  activities,  although  nose  films  and  tapes  of  sonar 
echoes  are  appropriate  for  training  In  echo  recognition. 
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STUDIES  OF  OPERATOR  VIGILANCE 


HFR  studies  In  vigilance  have  been  conducted  at  a  very  funda- 

j 

mental  level-  Vigilance  la  defined  as  the  ability  to  sustain 
attention  over  prolonged  periods  of  time  for  an  event  (signal)  that 
has  a  relatively  low  probability  of  occurrence.  An  additional 
characteristic  of  most  situations  requiring  vigl.ance  Is  that  it 
is  critically  Important  that  the  signal  be  detected  at  the  earliest 
possible  moment.  Furthermore,  failure  to  detect  a  signal  can  be 
dlsas  t roue . 


The  sonar  watchatander  Is  confronted  with  a  vigilance  task  that 
Is  unique  in  many  respects.  He  may  spend  hundreds  of  hours  on  watch 
without  experiencing  a  target  signal.  He  monitors  both  aural  and 
visual  displays  that  present  unique,  partially  redundant  Information. 
The  search  task  Is  demanding,  yet  boring,  and  the  opportunities  for 
a  sense  of  contribution  and  reward  are  few.  Sonar  operators  can 
expect  to  be  virtually  Ignored  for  long  periods  of  time  by  the  per¬ 
sonnel  uf  other  ship’s  activities,  hv  the  wntch  officers,  and  even 
by  the  command. 


Specific  Results, 

43.  A  vigilance  decrement  (loss)  occurs  In  the  first 
few  minutes  of  a  sonar  watch.  On  the  average 
about  30%  fewer  detections  are  made  of  signals 
that  are  of  such  intensity  as  to  be  readily 
detectable  wUen  the  operator  Is  fully  alerted  (16). 

43.  There  are  large,  stabln  Individual  dlfferencee 
among  operators  In  ability  to  sustain  vigilance 
for  the  types  of  aural  and  visual  stimuli  associ¬ 
ated  with  sonar  signals  (2). 

Individuals  who  are  vigilant  for  visually  dis¬ 
played  signals  are  not  necessarily  vigilant  for 
auditory  signals  and  vies  vsrss  (2). 
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The  more  difficult  it  is  to  recognize  the  signets  I 
on  the  display,  as  defined  by  percentage  of  de-  j 
tec  tl  on  s  under  alerted  conditions,  the  greeter  the  ^ 
performance  decrement  as  time  on  watch  progresses  , 

j 

The  frequency  of  "non -observing"  responses  (looking 
a  ray  from  a  visual  detection  display)  increases 
with  time  on  watch  and  is  positively  related  to  the 
number  of  signals  missed  (14).  j 

j 

Signals  can  be  missed  when  even  the  eyes  are 
fixated  on  the  detection  display  (14). 

If  probability  of  signal  occurrence  on  a  visual 
and  an  auditory  display  is  equal  and  both  displays 
are  being  monitored  by  the  same  operator,  more 
signals  will  be  detected  on  the  auditory  display  (8). 

1 

Operators  monitoring  more  than  one  display  are 
Inclined  to  attend  selectively  to  the  dieplay 
having  the  more  easily  recognizable  signals.  If 
the  displays  are  not  redundant,  thie  can  adversely 
affect  detection  probability  (8). 

Detection  performance  on  redundant  auditory  and 
visual  displays  is  supsrior  to  that  on  mltber 
display  used  alone  (8). 

Under  routine  watchstend ing  conditions  there  appears 
to  be  less  performance  decrement  with  auditory  than 
with  visual  displays  (2). 

The  probability  of  signal  detection  is  (within 
Halts)  positively  related  to  the  rate  of  aignal 
occurrence.  The  less  frequently  signals  appear, 
the  more  severe  will  be  the  loss  in  detections 
due  to  the  vigilance  decrement  during  the  watch  (l>. 


Signal  detection  performance  is  related 
ancy"  on  the  part  of  the  operator.  If 
hii  been  conditioned  to  expevt  signals 
irregular  intervale,  the  probability  of 
taction  decreases  as  a  function  of  the 
time  elapsed  since  the  lest  detection, 
if  he  ie  conditioned  to  expect  signals 
probability  of  defection  increases  as  a 
time  aince  the  last  detection.  Operato 
long  Intervals  between  signals  are  pert 
to  mlsalng  signals  that  occur  soon  afte 
been  detected  (9). 
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Immediate  knowledge  of  how  well  he  Is  doing  (per* 
formance  feedback)  reduces  the  operator's  vigi¬ 
lance  decrement  (1). 


The  introduction  of  artificial  signals  Increases 
the  probability  of  detecting  infrequent  real 
signals  ( 1 )  . 

The  level  of  vigilance  maintained  by  the  operator 
is  also  a  function  of  environmental  stimulation 
from  sources  other  than  the  detection  displays, 

If  the  extra  stimulation  Is  not  actually  dis¬ 
tracting,  the  added  "arousal"  it  provides  serves 
to  facilitate  vigilance  (6). 

Vigilance  decrements  are  less  levers  in  complex 
monitoring  situations  than  in  simple  ones  although 
the  absolute  level  of  performance  nay  be  lower  for 
the  complex  display  (i). 


When  the  signal  rates  on  e  visual  display  ars  low, 
a  variety  of  auditory  stimuli  reduces  the  vigilance 
decrement  (7) . 

Environmental  noise  reduces  vigilance  performance 
on  complex  vigilance  tasks  (1). 

Short,  frequent  rest  periooe  are  belter  for  sus¬ 
taining  vigilance  than  long,  leis-f requent  ones  (1). 

Performance  on  vigilance  tasks  le  not  reliably 
predicted  from  scores  on  conventional  peychological 
tests  of  aptitude,  temperament  or  motivation. 
Traditional  sensory  threshold  ssasures  ars  only 
slightly  predlctlv#  of  vigilance  performance  (4). 

Detection  performance  during  a  short  test  of  vigi¬ 
lance  is  predictive  of  vigilance  during  prolonged 
wetchstandlng.  Men  most  sensitive  to  tho  discrimi¬ 
nations  required  by  the  operational  display  show 
the  least  decrement  in  performance  (2). 


There  le  little  doubt  that  sonar  target  detections  are  made 
less  frequently  and  with  greater  delay  ea  e  reeult  of  losses  in 
vigilance  on  ths  part  of  operators.  The  often  reported  differences 
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in  detection  ranges  between  routine  and  "alerted"  search  during 
actual  sonar  operations  is  an  additional  objective  reminder  of  this 
fact.  Wore  serious,  however,  is  the  unknown  number  of  detectable 
targets  that  go  completely  unnoticed. 

Failure  to  detect  detectable  targets  is  also,  of  course,  the 
result  of  factors  other  than  vigilance  loss,  such  as  equipment  cali¬ 
bration,  operating  technique,  and  visual  search  pattern.  What  to 
do  about  aome  of  the  non- vi gi lance  problems  has  been  discussed  else¬ 
where  in  this  summary.  Concrete  steps  can  also  be  taken  to  help 
minimize  the  vigilance  decrement: 


a)  The  differences  among  operators  ip  suscepti¬ 
bility  to  vigilance  loss  while  monitoring  sonar 
displays  can  be  measured  and  used  in  qualifying 
them  for  various  watchstanding  tasks. 


Injection  of  synthetic  si 
means  of  increasing  signs 
combating  the  effects  of 
Minor  modifications  to  p 
board  equipment  (signal  l 
adequate  for  this  purpose 
implementation  would  requ 
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should  be  programmed  and 
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the  senar  team. 
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However,  successful 
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performance  monitored 
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Synthetic  signals  can  also  be  used  to  provide 
much  needed  recognition  end  performance  feedback 
to  operators.  It  would  be  possible  to  extend 
the  technique  to  Include  shipboard  training  in 
search  techniques,  making  proper  bias  and  gaip 
settings,  calibration  of  displays,  etc. 
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VII.  RECORDING  OF  TARGET  DATA  AT  SEA 


I 


The  recording  and  analysis  of  representative  lubnarlna  and  non¬ 


I 

1 

I 

I 
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submarine  contacts  made  snlle  using  operational  equipment  at  sea  Is 
a  fundamental  requirement  for  determining  the  classification  capa¬ 
bility  of  an  ASW  system.  Such  data  are  needed  to  determine  the 
quantity  and  quality  of  clues  producible  by  the  equipment.  Further¬ 
more,  the  recordings  also  can  be  prepared  In  teat  fora  for  measuring 
the  abilities  of  ASW  personnel  In  clue  recognition  and  actual  classi¬ 
fication. 

The  first  systematic  collection  of  target  data  specifically 
directed  at  the  classification  problem  was  made  by  NEL,  with  HFR 
assistance,  using  SQS-10/11  equipment.*  Since  that  time,  HFR 
periodically  has  made  additional  collections  as  the  fleet  received 
new  equipments  or  Important  modifications  to  older  equipments. 

In  each  can,  analyses  have  been  performed  to  redetermine  the 
adequacy  of  the  displayed  Information  for  classification. 


I 

I 
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Specific  Results 

63.  Representative  samples  of  submarine  and  nonsubmarlne 
contacts  as  displayed  by  the  8QS-29  series  sonars 
(Including  VDS)  were  recorded  and  analyzed  (22). 

64.  Representative  samples  of  submarine  and  nonsubmarlne 
contacts  as  displayed  by  the  SQS-23  sonar  were  re¬ 
corded  and  analyzed  (22). 

69.  the  first  system  for  recording  target  data  from  the 
displays  of  an  airborne  (.'elf  tenter)  sonar  system 
was  designed  and  developed.  Successful  recordings 
of  contacts  as  displayed  by  the  AQS-io  sonar  were 
made  ( 19 ) . 


I 


66.  The  first  sound  notion  pictures  lor  training  and 

testing  recognition  of  faint  target  signals  presorted 
by  scanning  sonare  was  developed  (9). 
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♦Under  an  earlier  contract. 
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67,  The  only  effective  doppler  performance  testa  for 
SQS-4,  SQS-29,  and  SQS-23  sonars  were  constructed. 

These  tests  were  comprised  entirely  of  actual 
target  recordings  with  doppler  values  determined 
under  carefully  controlled  conditions  (12). 

68.  Seven  motion  picture  tests  of  SQS-23  contact  data 
sere  developed  for  use  In  measuring  the  classifi¬ 
cation  skills  of  ASW  personnel  and  testing  the 
utility  of  special  classification  aid-  such  as 

HH I P  and  MITEC. * 

Importance  to  the  Navy 

The  motion  picture  tests  have  been  reproduced  and  distributed 
by  the  Bureau  of  Personnel  to  all  ASW  training  facilities.  They 
constitute  the  only  existing  effective  aids  to  SQS-23  target  classi¬ 
fication  training. 

Target  recordings  have  also  been  distributed  to  industry  on  a 
limited  basis  when  requested  by  the  Navy.  These  havn  had  an  Impor¬ 
tant  Influence  on  design  concepts  for  specialized  classification 
equipment  now  In  various  stages  of  development. 

Doppler  tests,  elides  of  graphic  recorder  trace*,  and  films 
designed  to  train  faint  echo  detection  have  also  been  made  available 
on  an  Informal  basis  to  the  ASW  Schools. 


*Mo  report  describing  these  films  wee  Issued  under  this  cont-ect. 
A  full  analysis  and  an  Instructor's  guide  was  published  under  a 
separate  contract  with  the  Bureau  of  Personnel. 
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VIII.  DETESMI NATION  OF  CALIBRATION  AND  MAINTENANCE 
SKILLS  OF  SONAR  TECHNICIANS 

It  has  been  evident  for  some  time  that  the  complexity  of  sonar 
equipments  has  been  Increasing  at  a  faster  rate  than  have  the 
abilities  of  sonar  technicians  to  cope  with  the  calibration  and 
maintenance  requirements  tnat  are  the  Inevitable  result  of  such 
complexity . 

Until  recently  little  attention  has  been  focused  on  the  capa¬ 
bilities  and  limitations  of  sonar  technicians  In  the  area  of  mainte¬ 
nance.  There  are  several  reasons  for  this,  and  they  are  largely 
unique  to  sonar  operations:  (1)  no  easy  means  exists  for  checking 
the  actual  operating  status  of  the  sonar;  (2)  it  Is  difficult  to 
separate  the  effects  of  sonar  leater)  "conditions"  from  equipment 
conditions  In  evaluating  sonar  equipment  performance;  (3)  except 
during  ASW  exercises,  little  attention  la  paid  to  sonar  equipment 
performance  since  no  means  exists  for  encountering  contacts  on  any 
but  a  chance  basis;  (4)  the  ASW  officer  generally  is  nul  sufficiently 
trained  to  challenge  statements  of  the  technicians  about  the  status 
of  the  equipment. 

Work  by  HFR  in  this  area  has  been  directed  toward  the  objective 
determination  of  the  status  of  equipment,  on  the  one  hand,  and  the 
corresponding  skills  and  knowledge  of  sonar  technicians,  on  the 
other. 


A  test  of  calibration  proficiency  for  the  SQS-23 
was  developed  which  shoved  that  the  average 
rated  technician  lacks  the  knowledge  neeessary 
to  understand  the  effects  of  various  calibrations 
(24)  . 
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The  "cookbook"  calibration  procedures  outlined  in 
the  technical  manual!  were  found  not  to  produce  a 
fundamental  understanding  of  the  effects  of 
various  adjustments  on  the  status  of  the  equipment 
(24)  . 

Substantial  errors  of  calibration  were  found  to  be 
the  rule  rather  than  the  exception  in  a  sample  of 
S$S-23  destroyers.  t or  example,  the  average  error 
In  range  calibration  was  well  beyond  officially 
stated  tolerance  levels  (24). 

An  improved  procedure  for  bearing  alignment  with 
the  SQS-23  was  developed  (24). 

An  analysis  was  performed  to  determine  how  various 
calibration  errors  are  specifically  related  to 
performance  deficiencies  in  detection,  target 
classification,  tracking,  and  fire  control  (24). 

An  analysis  mas  performed  showing  that  the  training 
given  to  U.S.  Navy  sonar  technicians  is  far  less 
extensive  then  that  given  to  European  technicians 
with  similar  maintenance  rssponslbl 11  ties  (27). 


:•  to  Ww VJ 


A  multitude  of  Interrelated  technical  and  administrative 
problems  have  limited  progress  in  developing  maintainable  sonar 
systems  in  the  U.S.  Navy.  Substantial  improvement  can  be  predicted, 
11-  (1)  the  effort  to  assess  technicians'  capsbllltlee  by  objective 

teetlng  proceduree  is  continued;  (2)  training  programe  are  extended 
or  modified  in  accordance  with  the  findings  of  such  assessor nts ; 

(3)  equipment  designers  are  compelled  to  employ  technlquee  and 
components  that  reflect  the  current  state  of  the  art  In  designing 
for  maintainability. 


CONFIDENTIAL 


KL 


£ 


wteiiir^f 


'if^;  : 

ML 


-i&m* 


CONFIDENTIAL 


IX.  ANALYSES  Of  ASW  SYSTEMS  IN  OPERATION 

Although  the  majority  of  the  investigations  conducted  by  HFR 
under  contract  tlonr  2649(00)  have  been  experimental  in  fora  and 
uii-acteJ  toward  very  specific  questions,  a  fee  have  consisted  of 
broad  systems  analyses  encompassing  all  phases  of  operation  of  a 
complex  ASW  system.  To  date  these  have  been  concentrated  on  sir- 
borne  systems,  usually  at  the  request  of  an  operating  command. 

Specific  Results 


! 


I 

i 


75.  Object  evidence  concerning  the  actual  capabilities 
of  MAD.  JULIE,  and  Sonebuov  systems  Jjx  the  hands 
of  typical  operators  Is  extremely  limited  (18). 

76.  Training  exercises  typically  do  not  provide  oppor¬ 
tunities  for  false  positives,  that  la,  the  possi¬ 
bility  of  reporting  contacts  ehen,  In  fact,  no 
submarine  la  present.  Exercises  should  be  designed 
so  that  "expectancy"  Is  not  a  contributing  factor  In 
measuring  operator  detection  capability  (16). 

77.  There  Is  much  room  for  Improved  operating  procedures 
In  the  use  of  the  weapons  system  trainer  for  ASW 
patrol  aircrews.  A  similar  conclusion  holds  for 
needed  Improvement  in  team  communication  procedures 
In  the  aircraft  Itself  (18). 

78.  Better  use  can  be  made  of  ASCAC  In  evaluating  the 
mission  performance  of  ASW  aircraft  teams  (18). 

79.  The  trainer  developed  for  AQS-10  sonar  operations 
Is  useful  foi  routine  procedures  training  only. 

It  la  totally  Inadequate  to  meet  the  needs  for  team 
training  or  training  in  target  detection  or 
classification  (17). 


lMP9r,t.mst  -la.  .tnt  ,M»yx 


A3W  systems  continue  to  grow  In  complexity.  White  soee 
functions  will  be  eleost  completely  automated  In  systems  now  under 
development,  humane  will  continue  to  play  kay  rolaa,  at  soma  stags 
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or  another.  In  the  processing  of  data  and  the  Baking  of  decisions. 
Many  past  dissatisfactions  with  human  performance  In  ASV  stem  from 
the  limited  capabilities  of  the  system’s  sensors,  from  poor  displays, 
and  from  the  limited  opportuni tiift  the  personnel  have  to  practice 
basic  acquired  skills  in  the  »peratlng  environment 

The  substitution  of  automatic  date  processors  for  human  ones 
mill  not  solve  the  fundamental  problems  of  limited  sensors,  loss**' 
than-op tlmum  displays  or  Insufficient  AS*  experience.  Rather,  the 
likely  result  Is  a  substantial  Increase  In  calibration  and  mainte¬ 
nance  problems  that  are  Just  ss  difficult  to  cope  eitb,  or  more  so,  - 
than  the  operational  problems  the  automatic  processor  mas  designed 
to  eliminate. 

Slde-by-eide  comparisons  of  the  performance  cepobllltlea  of  nem 
complex  systems  mltb  older,  simpler  systems,  under  representative 
eatraUm  conditions .  appear  to  be  somevbat  unpopular,  If  their 
number  Is  any  criterion.  There  Is  a  growing  suspicion,  however, 
that  many  of  the  newer  systems  have  not  only  failed  to  achieve  their 
theoretical  performance  level  In  the  hands  of  the  fleet,  hut  actually 
do  not  perform  as  well,  from  an  overall  systems  point  of  view,  ms 
some  of  their  grandparents. 

There  must  be  a  more  adequate  solution  to  the  Kavy's  operating 
problems  than  the  simple  substitution  of  next  year's  model  for  last 
year's,  at  several  times  the  cost.  it  would  seem  that  the  point  has 
been  reached  where  more  improvement  might  result  from  concsutratlon 
on  the  human  problems  rather  than  on  the  electronic  problem*. 
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